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Dkt. 64241 

IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

Applicants : Fetter Ericson and Henrik Hoglind 

Serial No. : 09/784,550 G.A.U. 2673 

Filing Date : February 16, 2001 

For : CONTROLLING AN ELECTRICAL DEVICE 


Assistant Commissioner for Patents 
Washington, D.C. "^0231 


RECEWED 

f£B0 4Z00Z 

Sir: Techno\o9V center 2600 

PETITION TO THE COMMISSIONER 
UNDER RULE 1.7 8 (a)(6) 

Applicants hereby petition the Commissioner pursuant to Rule 
1,78 (a)(6), and any other applicable rules, to accept English- 
language translations of non-English language provisional 
applications. 

Applicants filed this application on February 16, 2001. In 
the accompanying transmittal letter, as acknowledged in the 
official filing receipt. Applicants claimed the benefit under 35 
U.S.C. § 119 of two provisional applications: No. 60/208,164, filed 
May 31, 2000, and No. 60/208;169, filed May 31, 2000. 

Applicants filed those provisional applications in the 
Swedish- language and later filed English- language translations in 


those provisional applications on October 6, 2000. 

Applicants, however, did not file the English- language 
translations of the provisional applications in this application. 

- " Rule--1.78- (a) (5) currently states that an English- language 
trcinslation of a non-English language provisional application must 
be submitted during the pendency of the non-provisional application 
and within the later of four months from the actual filing date of 
the non-provisional application or sixteen months from the filing 
date of the prior provisional application. 

Applicants believed that this rule was satisfied by submission 
of the English- language translations of the provisional 
applications in the file of the provisional applications within the 
required time frame. 

Applicants note that the Patent and Trademark Office has 
proposed an amended Rule 1.78 (a) (5) (iv) in agreement with 
Applicants' understanding. See 66 F.R. 46409 (September 5, 2001) . 

So as not to jeopardize any rights of Applicants to claim the 
benefit of the provisional applications. Applicants submit this 
petition under present Rule 1.78 (a) (6) on the ground that the 
filings in this application of the English- language translations of 
the provisional applications were unintentionally delayed. 

In connection with this petition. Applicants state that the 


entire delay between any date that the English- language 
translations were due to be filed and the date of this petition was 
unintentional . 

. . English- language ...translations . of the .above-mentioned 
provisional applications are attached hereto. 

Applicants submit that no fee should be necessary in 
connection with this petition, including any fee under Rule 1.17 
(t) . However, if any fee is deemed necessary, please charge the 
fee to our Deposit Account No. 03-3125. 


Respectfully submitted. 


Dated: December 


2001 


I hereby certify that this paper is 
being deposited this date with the U.S. 


Norman H. Zivin 

Reg. No. 25,385 

COOPER & DUNHAM LLP 

1185 Avenue of the Americas 

New York, New York 1003 6 

(212) 278-0400 

Attorney for Applicants 
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Assistant Commissioner for Patents, 



Norman H. Zivin 
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VERIFIED TRANSLATION 


I, ihc undersigned Patricia HARDING. BACHons), 
Icclmicai Iranslator to RWS Grotip pic, of Europa House, Marsham Way, fierrards Cross, 
Buckliigliaiuslilie, Eui^Iuud, do hc^by declare: 

(1 ) That I duji well Ikiiiiliar with the Swedisli and English languages; 

(2) That the attached is a true and accuiatc u-aiislalion into the English language of 

I 

the Swedish teTCt of this Patent Application entitled ''Input Unit Aiiangcuicur' LhaL was filed 
in the US Patent and Trademark Office on 31 May 2000- 

(3) Tbnt all statements made herein of my own knowledge are tiue and dial all 
statements made on information and belief arc believed to be true; and fiulhcf lhai these 
statements were made with the knowledge that willful &ldc statements and the like so made 
are punishable by fine or imprisonment, or both, under § 1001 of title 18 of the United States 
Code and tliatjsuch willfiil felse statements may jeopardize the validity of the application or 
any patpsnt issued thereon. 


Daled Qiis 21st day of August 2000 



P.HARDlNCf 
Fur and on behalf of RWS Group pic 
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Technical field 

This i-nvpntinn nonr.erns an input unit arrangement 
with a mouce function and an input function, comprising 
imaqe -recording lueciny Iu-l xeuuiJiii^ iuiaicjes and signal - 
prorftflfling means tor processxng the images CO achieve che 
mouse function and the input function. The invention also 
coucerxiy an InpuL uniL aiicuiyeuient with a mouse function, 
a mounp. pari anri i3!=ip. nf s^r\ abf?ol.ute position- coding pat- 
tern. 

Background o£ the luvejiLiuxx 

A mousse is used to position a cursor on a computer 
Gcrccn and to give variouo commando to the computer. 

Currently, Lhti uwjidL cuiiuiiun iiiuutie is an electronic 
typp . HnwpvpT, an nphi r.a I mou5=ie i fi a I flo ava.i labie . 

JP 09190277 diEsclosee an optical mouse which has a 
CCD line sensor lor the X-axiy and a CCD line tieufciuj. Luj. 
the Y-axis. Data which is recorded by the CCD line sen- 
ooro at a particular time ic compared with data which 
ia xeuurded at a aubtieciuenL Lime, by means of which the 
mnvRmP.nt of hh« mmifift in hhe=» X- and Y-dirertion can be 
determined. 

U5 PiiUt-xxL US 4,614,553 diacluaea d aliuildi. upLicdl 
mouse which can determine its absolute position on a 
mouDc pad which ic provided with a cpecific line pattern - 

The combination of a mouse function and an input 
funccion in an inpuc unin is also Icnown. An example of 
this is shown in the appl i cant ' a .SwprJiflh Patpnt Appl i - 
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cation No. 9803455-6- Tliiti describes an input unit which 
comprises image - record nng mp.ans fnr- rerording images 
and image proccooing meanc for processing the images to 
achieve nhe input luncLioii cixad Lhe uiuatit! luncLion. The 
mou?!«=* tnnchion is more specitically based on Zhe deter- 
mination of the relative pocitionc of images recorded in 
tsucceizsiidluii. 

It is a genpTfll rp.qiii nrpmRnh hhat a mouse or other 
input unit ic to be able to carry out as many functions 
as possible and be used by the ubex la dti rle-x.ible ctud 
simple a way as possible. 
Sum mary of t ho I nvcnt ion 

An ubjeuL u£ Lhe InveiiLlon is therefore to make it 
posBiblR for- thp urrt hn r.hange between riitterent timc- 
tionc of an input unit quickly and easily- 

Thia ybjeut la auhieved by dii liiiJuL uiilL eLj-xcLiiyeiiiwiiL 
according to claims 1 and 6, a mouse pad according to 
claim 12 and uce according to claim 18 • 

An iiipuL uiiiL arrangement according to the inven- 
h-ion hhufi r.ompri Ptefs image-recording means tor record- 
ing images and signal -processing means for processing 
Lhw liiiayeti Lo eiuLieve the muuae funcLion and the InpuL 
function, the input unit arrangement being arranged to 
change from the input function to the mouse function when 
the signal-processing means detect a predetermined posi- 
tion-coding pattern in one of said images- 
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Tliuy, iufciLead of the user changing the fiinction 
manually, Mnp input, \init arrangement automatically 
changed from the input function to the mouse function 
when the predecermined posit ioa-uodiny pctLLwi-n is 

The pooition coding pattern ie advantageously locat- 
ed uxi ci muuue pctd which is used together with the input 
unit aTTangpmp.ni-.. When the nser places the input unit on 
the mouac pad, the image -recording means record an image 
Of Che poslcion-codinq pattern on the mouae pad. when the 
flignal -pTnnP.fi.c;ing means detect that the position-coding 
pattern io the prcdctormined one, the recorded images 
are proceaaed in auch ct way that the mouse function is 
achieved. 

In thi!3 connection it ohould be pointed out that by 
input: funcrion is meanc here a function whereby the uaer 
nan inptiti infOTmatiori into a receiver tor storage and 
processing within thio, ao diotinct from the mouce fimc- 
Lioxi which ia uaed lux pualLioniny purposes - 

The whole input unit aTTangprn^nt nan hR nnnhainp.d in 
one caoing, that io in one phyoical unit. It can alco be 
divided between lwo physical casings, lor example a user 
nnih whir.h the nsser operates and a computer with which 
the uoer unit communicatco , in which cace part of the 
signal processing can be carried out in the computer- The 
Signal -processing means can thus be fully incegraced with 
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rhe imaqe-recordixiy iiiecLnti, cdu be partially integrated 
with these or a-rp not integrated with these at all. 

Of Gourcc, the input unit arrangement can also be 
suicahly arranqed to chaay^ Crcjai Lhe uiuuse f LUiction to 
the inpi.7t fnnrhinn when it detects another pattern than 
the predetermined position coding pattern in one of caid 
imaqes/ so LhaL an auLuuiciLic uhctii9e is also achieved for 
the input funntion. The other pattern can iDe an arbitrary 
pattern, that ic the 'input unit arrangement detects that 
an iraaqe does noc contain the pred^sLeriuined puaiLiuii- 
ending patt«m . Tt nan also he another predetermined pat- 
tern, but doca not need to be a pooition- coding pattern. 

The riL'BL poyiLi'un-cudiiiy paLLej-ii is advantacjeousli' 
a first abRoliTtp. po5=ii!ti on-nodi ng pattern which codef? a 
plurality of pocition'c, the input unit arrangement being 
arranqed co carry out; the chanqe IroKi Lhe iiipuL JCuxiuLion 
to thR mm]i=;R function when the si gnal -processing means 
detect one of said plurality of pooitiono on the baaio of 
Lhe predeLei'iuiued yaL,Lern. 

An abj=io1iitH posi ti on-r.odi ng pattern is advantageoi3 5=! 

ac the identification of this requires little processor 

I 

capacitiy in the input: unit arranqement. The pattern can 
be deter.tRd in the form of the positions or coordinates 
which it codc3- No mJtohing of any prcvioucly otorcd pat 
tern needs to be carried out. In addition, if the mouse 
funccion is based on 'posinion denerminacion using an 
absolute position-cocling pattern on a mouse pad, the 
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input: unli: arranqement only utieaa Lu be supplemented by a 
simple prorjram routine whinh nhP.rkfi whether the positions 
lie within the area which ic coded by the position-coding 
pacnem on the mouse pad and dcjLlvdLeB the mouse fxmction 
if this ±s thp. nafift . 

The first abaolute poaition coding pattern is advan- 
tageously pare of a larger vlrLudl absolute position-cod- 
ing pattern which coTTipri rp.a a se.r.mnd absolute position- 
coding pattern, the arrangement being arranged to change 
from uhe mouse function to the iupuL fuiicLion when it 
detects a position whir.h 1s coded by the second absolute 
position-coding pattern. The second abaolutc pocition- 
COdlnq pacrern can, for example, be deJicaLed to the 
recording of handwritten tpvt, rd that when the signal - 
processing meano detect coordinates which are coded by 
Chis paru of che pattern, the cuuidiiiriLeti axe processed 
as TepTPHPTiti ng hanriwriting. 

UG 5; 052,434 describes an example of an abcolute 
posicion-codinq pattern. The AyplicctnL'u Sweditih PdLeuL 
Applications qqnigS4-9 and 5^P1 99h3541.-2, which were 
not publicly available at the time of filing the present 
application, describe other exampley ul dbuuluLti potii- 
tinn-notiing p;9thftrni=i: These patterns are used to digitize 
handwritten text which is written on a writing curfacc 
provided wich chis patteni. They can thus be used for an 
input function of an. input unit: for' a computer. They can, 
however, also be used to achieve r mmiHR fiinrtinn nf an 
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I 

inpur Tonit- II Lhe paLL«=ixxi codes a sufficiently large 
nuTuber of positions, a firRt pr^rt ot the pattern, that 
is a particular pocition or coordinate area, can be dedi- 
cazeti to the mouse fuiictioii aad a uecuij-d part of the pat- 
tern to thft input function. The input unit can Chen auco- 
matically change from, the input function to the mouse 
function when iL UeLtJuLa a. puaiLion situated within the 
part of the pattern rtpriinat«rJ to the input tunction, and 
from the mouoc function to the input function when it 
dececcs a position situated within the pctxL deJlcaLed to 
thp. input fnnr.tion, 

j 

In addition, the; firat abcolute position-coding pat- 
tern is advanLaqeuualy dividtid into at least two domains, 
the input unit be.-ing RTT^gngnd t.n arhleve ditterent tunc- 
tions depending upon which of caid at least two domains 
is detected by the iaiaye-proyeyuiny meetnti. 

The idea ot dividing the absolute position-coding 
pattern into different parta can thuc be utilised in a 
form of tree aLruuLu-cie yu LhaL the area which is dedi- 
cated to the mouse function i r divided into flub-area£3, 
oo called domainc, to which are associated different 
functions of the input unit arranyemeiiL . lii Lhiy way a 
user can cause the input unit arrangement to carry out 
different functionc in a very simple way, depending upon 
where he places the input unit on a mouse pad- 
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The idea described above can of course be utilized 
foT Fin inpiih unit arrangement which has only a mouse 

function- i 

Accuxdiiiy Lcj a second aspect of the invention, this 

I 

t 

concerns theretore anj input: unic arrangement: with a mouse 
function which con^rijeee image -rQcording means for 
xecoi-ding images and 'signal -processing means for pro- 
refising images to achieve the mouse =£unccion, t:he signal- 
processing means beinlg arranged to detect an absolute 

pasiUioa-tJudliiy peiLLeji-n in one of said images, to deter- 

I 

mine a position based on the absolute position- coding 


pattern and to detect 


to which of at least two domains 
the position belongs J the input unit arrangement being 
arranged to carry out! different functions depentiing upon 

I 

which domain the signal -processing means detect. 

The liipuL uiilL arrangement thus contains inf ox-ma- 
tion about at least: tiwo different: domains of the abso- 
lute position-coding jpattem and has different functions 
associated with these! domains. 

The input unit a,rrangemenr is advantageously arrang- 
ed to generate a command for control of an external com- 
puLej: when it detects a predetermined one of said at 
least: i:wo domains, instiead of t:he user clicking with 
a mouse button, he can. thus read the absolute position- 

i : 

coding pattern in a domain. He can then ucc the input 
unit arranqement: in essentially the 
poKi tinning a cursor and tor giving 


yaiue way buLh Lux.' 
a command to the 
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computer witti which Liiti lupuL unit arrangement comitiu- 

I 

nicates. I 

The command can jadvantageously concern the opening 

i 

Of a program In the cjomcputer- The uaex can then for exam- 
ple cause the rnmpntplr open a program for eleccronic 
mail simply by placirig the input unit arrangement on a 

domain which is dedicJciLed Lu this. 

j 

In addition, thej input unit arrangement is advan- 
tageously arranged to work in a relative mode when the 

signal -processing means detect a duMialu dedicated to 

I 

abPsoLute mode when the signal-pro- 
a domain dedicated to absolute mode . 


relative mode ^nti in 


cessing meana 


detect 


The use ol both -a x eld Live mode and axi absolute mode 
increases the f levibijT i ty for the user. 

The arrangement -ic advantageously arranged to work 
in a scrolllnq mode vl^hen the yiynal-pxuuetitiing means 
detect R domain d«=idir:ated to scrolling mode. 

This thus replaclcs the ocrolling roller which is to 
be found on some meclIi.axilL:al mice- 

The inpxit fnnr.tion ativantageousily compriseB a scan- 
ner function ao that: the input unit- can be used to input 
rexc and/ or images . 

Annnrding to a tihird aspect ot the invention, this 

j 

concerns a mouse pad j which io provijded with a position- 
coding pattern which j is divided int.o at leaat two domains 
which are intended cp achieve different functions of a 
mouse - 
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The ctdvaiiLd-yes of this mouse pad axre apparent from 

I 

thp Rhovp. (ii p:ru5=;f!i on pt the input unit arrangemenr , 

According to a fourth aspect of the invention, this 
coiiue-xny uwe u£ cui ctblsolute position- coding pattern to 
cause an input unit airrangement which has a mouse f\inc- 

tion to change from aj first to a second function. 

j 

The advantages oif this use are apparent from the 
above. | 
Brief Description of [the Drawing 


EiiLbudiiueiiLtj of t 


in greater detail witp reference co che accompanying 


drawing in which the 


Lie invention will be described below 


figure shows diagrammatic ally an 
euibodiiuenU of axi input \init arrangement according to the 
invention, an emhodiment of a mouse pad according to the 
invention and a computer with which the input xmit 
ai-i-augeLueiiL commuiiicajtes , 
Description of a PreEerred iiTnhodimeni: 


The figure shows 


a mouse pad 100, a computer 200 and 


an input unit 3 00 for the computer. Together with pro- 
grams in the computer 200, the input unit 3U0 £orms an 
input unit arrangement according to the invention. 

The mouse pad 10 0 is divided into a plurality of 
different areas, in tas a first: working field 110 for 
relative mouse function, a second working field 111 for 
absolute mouse function, a scrolling field 112/ a scanner 


field 113 for chanqir 


q to scanner function and a command 


10 
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Held 12 0 ill which a number of predetermined coTranands are 
indicated 

An abaolute pocijiion- coding pattern 150 extends over 

Che whole mouse pttd. ;Fuj: Lhe ticike of clarity, the pattern 

is 53hown greatly enla|rged on only a small pare of Che 

I 

mouac pad. j 

Thtt dLjBuluLe position- coding pattern can be any type 

] 

which gysteTnat,-in;:5 1 ly hocles? coordinates for a large number 
of pooitionc on the Ttjouee pad, so that the position of 
Che input uniL can bej dti Lei. mined regardless of where the 


input unit is placed 
The pattern can^ 
in US 5,852,434, wher 


on the mouse pad. 

for example, be of the type shown 
e each position is coded by one spe- 
cifin Rymbol . However, it can advantageously be of rhe 
type chown in the Applicant's Swedish Patent Applications 
SE 9901954-5 and SE 9903541-2, where each position is 
coded by a plurality of symbols and each symbol contri- 
butcc to the coding of several positions. These applica- 
Liuiiti, which were notj publicly available at the time of 
t.hp filing nf the present application, are incorporaced 
herewith by reference- 

III Lheue IdLLwi applications the pattex-n is con- 
structed of a small r.umber of cypes of symbol- For exam- 
ple, it can be constructed of two different-sized dots 
which represent a one and a zero respectively or of a 
doc which can have four dlfferenc posicions in relation 
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The figure shows 
luouae pdd cuiiaLiuuLed 
Thesse represent a one 


cia.L«d wiLli dilfexeiil:. 
greater detail below 
code pocitione within 


Lu dL idtiLej: point and in this way cam code four different 

the position- coding patteim on the 
of dots 5 of two different sizes . 
and a zero respectively. A nurnber 
of ouch cymbolc, for sxample 5x5 aynibols, combine to 
code the coordinates of a point on the mouse pad- 

Ditterent parts of the position-coding pattern, that 
±3 different co-ordinate areas or domains, can be asso- 

functions/ as will be described in 
For example, the coordinates which 

the Bcrolling field 112 can be 

1 

associated with a scr|oiling function so that when the 

i 

input unit arrangement ! detects coordinates which lie 

field it generates a scrolling com- 

200, As a x-esult, the user can 

j 

achieve scrolling simply by placing the input unit 3U0 
in the scrolling field^. 

In this embodiment the input unit 30 0 has a mouse 
function and an input function, more specifically a scan- 
ner or reading pen function- 

The input Uiiit 3 00 has a casing 1 in the shape of a 

pen, une short side of j the casing has a window 2 through 

! 

which images are recdrded for the different f\anctiong of 
the input unit , 

The casing 1 contains principally an opLics part, an 
I f^ntrnni r. part and a! power supply. 


12 


within the scrolling 
iud.nd Lu Lhe uoiiiputer 
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{ I 


The optics coTr^oiient comprises a plurality of light- 
emitting diodes 6, a lens system 7 and an opcical sensor 
8 which constitutes fc^e interface with the electronic 

part , '; 

The light- emitcikg diodes 6 are intended to illumi- 

y^ate a surface which -is then below the window, 

[ j 

The lens system '7, is intended to project an imacfe of 
tiie surface which is -jDelow the window 2 onto the light- 
sensitive sensor 8 in' as cor-rect a way as possible. The 

optical sensor 8 can 'ponsist of a two-dimensional quadra- 

'I 

tic CCD unit (CCD = Charge -coupled device) with built-in 
a/D converter. Such sensors are commercially available. 

The power supply; for the input unit is obtained from 

i ! 

a battery i:^ , j • ; 

The electronic p^rt comprises a processor 2 0 with 

■I • 

conventional associat.'ed circuits, such as various types 
of memory, and associjated programs for carrying out the 

functions described here. The processor 20 forms part 

; I 

of the input unit arrangement's signal -processing means. 

The electronic part ajlso comprises a transceiver 26 for 

il I 

transmitting informatjion to/from the compviter 200. The 

[j j 

transceiver can be based on infrared technology or radio 
technoloqy for transnk^sion over short distances, for 
example in accordance! '^ith the Bluetooth standard- The 
electronic part further ' comprioco buttono 27, by mcano 
of which the user caii; coxitrol the ixxpuL uxilL, for e-x-ample 

r . " 

switch it on and off .jl I 
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The computer 2 00 


-is an ordinaary personal computer 


with circuits and programs which make possible communi- 


cation with the input 


uni 


t''3 00. However, in this embodi- 


meiiL Lhifci cilso contains* software which constitutes part 

i : 

o£ the inpuc unir arrangement's signal -processing means. 

The software stores ilif ormation about which functions are 

j 

associated with diffebent domains of the position coding 


pattern- The software 


is sliown symbolically by broken 
lines and areference numeral 210- 1 

As mentioned, thL input unit 300 has a scanner func- 


tion and a mouse funcjtion- 


i I 


The scanner funcjtjion io used to record text. The 
scanner function can be of the type • described in the 
Applicant's Swedish p'aiienc;Wo. iS)eJ04008-4 , where texr is 
recorded by recording' la plurality of imacjea with partial- 
ly overlapping content ;;' and" putting them together, after 

lii: Che put-togecher Image are local- 
stored in character-coded f ormat . 


which the characters 
ized, identified and 


The mouse function- is* used to control a cursor on 

qomputer 2uu. The mouse function is 


when the user moves the input unit 

ir: :• i 

2GG, the image 7 recording means 


1 . 


the display of a 
achieved as follows . 
3 00 on the mouse pad 

record images at a pr^ji^termlned frequency. Each image 

reproduces part o£ theji posit ion-coding pattern on the 

1 |i .' • 

mouoc pad, which part |ilD cuff icicntly large for the pro- 


cessor 20 to be able 


input unit on the movjsf L pad. More specifically/ the pro- 


' '1 . 't It 

ti6 determine the puaiLiun ul the 


•1 

■! 14 

.'I 
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cessor 2 0 local i'-^etf Llil synibols of which the position- 


coding pai-.i-.fiTn is=! r.ons^|ructecl in each image, nranslaces 
the oynibolc into coordinates according to predetermined 
algorithms and seixdy coordinates to the computer 200 


via thR tr^ansnelver 26. The software '^lu interprets the 
coordinates and convc,rtc these into /positioning signals 
for ct cuxsoi un the display 2 01 of ^he computer. 

ThR arrangement 'described above is used in the fol- 
lowing way. First assilm© that the user wants to use the 

i jl 

input unit ay an oxdiniiry relative mouee. He places the 
inpnh unit .'^00 in thq j 


belong to the working- j 


;:ield ilO it will generate commands 


Held 111 loi* dbtDuluL'e 

j I 

corresponding way/ wit 
210 maps positions in' 


:irst working; field lio. The pro- 
cessor 2 0 dctoctc the Coordinates in the image recorded 

1 1 ' * 

by Lhfci ueutDOi 8 a^d seipds the coordinates to the computer 

' J ' i 

200, in which tiie sottware' 210 dececcs chat rhe coordi- 
nates belong to the working field 110 and that they are 
Lhereluj.e Lo be inLerpreted as relative mouse functions. 
As long aa the softwarp 210 receives coordinates which 


Lo the computer 200 fo:: moving the cursor on the screen 
201 in a corresponding ■ way'* to the wpy the user has moved 
the input unit over t^L working field 110. The working 


moiise function can be used in a 
h zixe difference chat the software 
bhs' working field 111 to positions 


.1 . ' 
of the cursor on the 'compilitcr ocrccn 2 01 


Assume nexc chat:. 


coTTiputft-r :>nn. He can ;t]tiaric text in the same way as wich 


Che user edits d ducuiueiiL in the 
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a tradiLioiidl muuse by 2"cliickiiig" with the buttona 27. 
AssTAme that the uPSP.r t^|rs5t jwants to replace a first piece 
of text with a cecond jlieoi o£ text which is situated 
elsewhere in Lhe LexL/jThe user marks the second piece of 
hft^ct using the input "i'hen he places Che input unit 

in the command field vfi±aii\±s labeled with the command 
"cut" oil Lhe mouse pad|lOO. The input unit then sends the 


coord inat PR rp.ari from 


this 


tield to Che software 210 in 


the computer 200 whicli| identifies that the coordinates 
represent the cuuuucuid | .V cut " and creates the corresponding 
command tor the word-processing application concerned, 
which cute out the ma4w,pi©j=e of text- The user next 

iiicirka the first piece jbf text' using : the input \init and 

I' . ' ' ■ 
then naijRRfi the computer to p^ste the cut-out piece of 

1 ' j I 

teact in place of the narkeek text by*readino the coordi- 


iitiLetj lux Lhe commaiad 


JMow assume chac die uieri nexc wanes no encer text 

li M ' . . 

from a new£3paper in hi[s document- He first positions 

i I ; 

Lhfc! cuxaor in the reqiiai-edj pojsition using the mouae fiinc 
tinn at the. input unit; 

I ! 


Then he changes the input xonit 

I 

arrangement to the scajnneri fimction- by placing the input 


paste"' -using- the input unit 


. I 

I ! 


unit on the scanner fipld jL13. and scans in the text from 

! i * ' 

the newspaper. The teac: i;sj converted to character-coded 
format and transmitted to' the software which generatf?s 
commands for inserting: the tdxt in the pocition marked 
by the cursor. 


lis 
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Now citiauuiB that tfie user sees an intereating web 


adclreBR in hhft newspaper Ijie is reading and. wants to look 
at thic web page. He Ejlacis the input vmit 300 on ^.hfl 
coiranand field 120 wlLliiLlie text "wW" Reading coordinates 
in this field results I In |he software 210 creatlnq a 
command which openc a ;|eb | browser program in the computer 
200. Thfcdii Llie user cani change the input unit arrangement 
to hhft srfanner tunctioi the way described above and 


read the web address from 


text: is traiialeixed Lu 
t-.hfi pagft corresponding 
Finally, acBume t 

e-unail to a friend. He 

I, 

ft-mai I tieid ot the mo 


the newspaper. The recorded 


Lhe computer ; 2 00 which c&n open 


to 

lat 


places the input unit on the 


the e-mail program, Thj 

I' 

c-mail address and eve 
Lhe scannex- function. 
In addition, the 


■Che recorcked address. 

the user wants to send an 


Lse pad. Reading a pair of coor- 
dinates in this fieldlHresults' in the software 210 genP.- 
ratinq a coiimuind Lu Ll:ije computer which causes it to open 

U3er can then record rhe required 
I 

the content: of the message using 


marked "user-disf ined" 


i 

.ser can himself define which func- 


! i 
tions are to be implemented upon the detection of the 

couxdliiaLeti within varaLous domains, [for example the one 


carried out by means ot the software 210. 


»n rhe mouse pad loo. This can be 


As shown above / fe 
functions In a.' conveni 


vmi-t whinh -rp.ads coord Lna tea on a mbuse pad 


.c 
snr 


uocr can carry out a number of 

i 

way by uitt|iim u£ jusL oiie input 
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of couirse other* 


1^019 


ed scanner function am mouse! function can be incecrraced 


into the input unit ixi 
usability. For example|| 
makes ir possible co r.i_ 


coordinate area co cnej 
pad- 

Other commands c 
described above. 

The above example' 
arrangement according 


ons besides the above mention 


I. i 

order to further -incTf^piRR itR 

' ' ! 1 

it ' caii have ; a function which 

' • !. i 
cord handwritten text. Fur Lhly 


purpose a second posit'ion-coding pattern can be used. 

It ' i j 

which codes coordinate's for points within a different 


one. which is 


used on the mouse 


be"' created in addition to thooc 

I I 

ig just one eacample of how the 
a the 'invention can be dcoigncd. 


Based on che summary ok the ibventiiin, a person skilled 


in the art can achieve 
example . 

For example, the 
need to have both an i 
It can have juat a mo 


Lput 'function 


the mouse pad being ^Hr^ ^ 
couTse, withmit sny nh!pncff=i, to 


All functions do 
inq coordinates, Inst 
trolled using buttons 


e function, reading coordinatec on 
tie same way as above buL, o£ 
input] tunction. 


jijiot; , n 


In the example above. the 


pcLi-Lidlly arranged in' 
in Che com(puter 200 


a nnmhUr at Variants ot this 


nput uniL arraiiyeiuexiL dueu nuL 


and a monRP. funntin-n 


.ot need to be controlled by read- 


d; yttxLtilii f uiiuLiuns can be coxa- 


Jmi h 


input. 

signal -processing means are 
he ilnpsM.t unii: 3 00, and partially 
tIiIs! .division can be changed and 


i. 
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more or less ol Llie pJ|>cessing be carried out in the 


input •Quit . In the 


\{!1020 


1 


case it could be possible for 


1 


the signal proccaoing j|eanc to be completely integrated 
wirh the image -recordojl^q means in one ctnd Lhe same cas- 
ing. 


The input unit aijp-angeme:at can 

. 'li ■ 

other type ol cuuipLiLer! 
or a mobile telephnn«. 


based device, 


communicate with any 
for example a PDA 
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I 

What we claim and! 


J. £3 


1. All input unit arrangement with a mouse function 

j 

comprlsinq iniciyfej-ifcicording means 


and an input function,! 
for recording images ^5id Isignk] ^pTnfj:ft£3Sing means for pro 


cessinq Lhts lutetcjes to j 

i 

input tunction, c li aj 

! 

input unit arrangement 
input fun,ction to the 
pror.ftfl fling means deced 

^ i 

pattern in one of said irri^ges|. 

2 . All input unit 1 Lrrjangepent according to claim 1 , 

j I' i ' 

wJaerein the input: unit} atranq'ement fa axxctnyed to chaxige 

II \ \' 

from the mouse functicli t^pi tHe input function when it 


detects a different p< 


first absolune posiclc 


to sedure by Letters patent 


ichifeve! the mouse function and the 

\ 

r dSc r| e r i |z e a in that the 
is/iarranged to nhange trom the 
noui^e fiunctioh when the signal- 
a!'. 'predetermined puyi Lion-coding 


tdbrn to the predetermined posi- 


tion-coding pattern iiJ orie oS said imaqea 

! ' I 
3. An input unit I kriilangeSnpnt ar.r.ording to claim 1 or 

1 i' i 

2, wherein the predetdrml|n:ed poeitibn coding pattern ±c a 


qodir.q pattjern whi<jh uudes a plu- 

i if • ! i 

ralitv of positions, and ilwheifein th^ inpiah unit arrange- 

hange from the input 

the y iy xAdl - px uu es s ing 
of positions on the 
coding pattern. 


ment is arranged to cerr^.out the c 


function to the mouse j 
means detect one of s^id 


pl.UT'aT i 1".y 

■ ji i ■ ! . . 

basis of the predeterri ined posxtion 


4. An input uxiiL 


wherein thps fi-rflt abs^ lute pc^sit ion 
part of a larger virti al 


futtctlon when 


etxiliiiqement according to claim 3 , 


r 


i> i 


-coding pattern Is 
[Absolute p|Osit ion -nnd ing pattern 

(continued) 
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(conninued clciiui 4) 

which comprises a gennTnri ;3hso..ute pcisici OH- coding pat- 
tern, and wherein the input unit arrangement is arranged 
CO change from the luuuye ILuicibion to the input function 
when it riRhects a posilpionj. which is 
absolute poait ion- coding patt-arn. 

5. An ixipuL uiiiL arrangement according to claim 3 or 


4, wherein the fir;=it-. a.bsoiute 


tinnR de^pftnding upon w! 
the aignal proceceing 


divided into at least -wo " domains ai^d wherein the input 
unlC arranqemeiiL ±y eax.Lcinaed to carry out different £unc 

lich of i said At lease two domains 
neanls d.atect. 

6. All iiijjut unit arrahgetient with a mouse function 
comprising i m;gge-recor ling; meps foy recording Images 
and cignal -processing neans for processing the imageR tn 
achieve the muuufc! Tunc 
that the signal-processing; me^ns ar4 arranqed co detect 
an aboolute poeition-cDdiiig pattern 


iiiiayey, Lu determine a 


in one of said 
position based on the absolute 
poHitinn-nnding pattern arijd tp dececc to which of at: 

lea£3t two domains the posi'tich belo:igs, the input unit 

,1' II 

ciri'ciayemeiiL being arrangeji' to' carry 


tions depending upon which dqitnaln C 
means detect . 

7, An input unit arrangement according to claim 5 or 


6, Which is arranged rib qj^neijlate <x 


ling an evtRrn^al f:oTnpi:iter 
at least two domainc. 


coded by t:he second 


posir]. on- coding pattern is 


out different func 
le siqnal-proceasiay 


;^ouuLic±iid fox control- 


whejn it c^etecce a first: of said 


: 4' 
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•I 


8. An iapuL luiiL .Lieuigeipent aacording to claini 7, 
wherein said nnmm^^nrl i 


3 a comrfiand for opening a program 

I • ! ! I ' il 


in the computer, 


9, An input unit cii.tciiiye»i*=iiit according to any one of 


s 


L 


to wo|:k in a relative mode 
a means detect a domain dedicat- 


clajms S-R, whir.h is aarrai^ged 
when the signal proGcc|;in^_ 

ed to relciUive uiude aiji in absolute|| mode when the signal - 
procesBing mRans rietecj: ajidompin dejpicaced ro absolute 
mode 

10- An inpuL unit (Arxicingetnent according to any one 

• I'l I I i 

nf nlflims 5^-9, which is arranged coi work in a scrolling 

! • •!* T* I 

mode when the oignal-pproceeeing mQans detect a domaxn 


dedlcjciLfcid Lu scrolling 
11. An input unit 
of claims 1-5/ wherein 


luncLion ur ct LtaxL iiijjuL fmiqition- 


12 . A mouse pad wfiich is 


coding pattern, c h a 
pusi Lion- coding pattexjp 
at least two domains 


mode * 


arpangfement: Recording to any one 
the inp.ut fuinction is a scanner 


r aj c tl 


tiicfli arie inceipded zo achieve diffe- 
rent functions o£ a mcuseJ 

13. A mouse pad el^cojij-dirig to cAaim 12, wherein each 


of said at least: two. dbmaiins 


indication which makee 


: i 


iti 


provided with a positlon- 


^ r I 


the mousje pad is divided into 


is prdVided with a visual 


stand which function o|f t|he m|ouae ip achieved by mcanc of 
t-his domain. 


22 


zed in that the 


poSjSible '£or a user to under- 
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14- A mouse pad cn 
at least one domain is 


command for controlling a 


CL)i>(illnc 


nntp-nriftd tor 


lb . A mouse pad \sl6 

' . I : I 

command concern r openimg ^ 


^1 

computer . 


por*diii(^/ Lo claim 13, wherein the 


I; 


16- A mouae pad a<3.cordingi to ai- 

f 

ib, wherein said aL le<L;t>L j Lwo^ 

• [ 

which is dedicated to a^rh'! 
of the mouse . 

17. A mouse pad dKjsjuuj. 
12-16, wberpain ffa.i.cl at 
domain which Ls dcdica|:e.d 
rion of die mouse, 

18- Use of an ahfl&lut 


mouse function tu ulianje frod 


tion 


I{!I024 


1 


to claim 12 or 13, wherein 


program on the computer. 


y one of claims 1^- 
domains comprise a domain 

; 1 

an absolute mouse funccxon 


I 


lin^i to any one of claima 


least two domains comprise a 


to ii 


e d 


order to cauoc an inpult uiiit i!atrang||5ment which has a 


•a fir 


1! 


the generation ot a 


phieve a scrolling fi.inc- 


sitiOBL-coding pacuem in 


5t to a second func 


*01 1^/19 15: 16 FAX +46__40 28q516_ 


AWAPATENT 


Abstract of the jn 


\d\02S 


flr I. 


tern vhicii codes cootd 

I U . !i' III' 
on the mouse pad- Di^fbrcnt axpas o 

furicL 


dedicated CO dif f erepi: 
ment can read the posi 
input unit arrangement 
pad, a user can cause 

i 

out different function 
from the mouse functiozji tjo] 


i on 
in 


' ■ i i 

A mouse pad is pr(|vi'clbd |ith a position codxng pat- 

naififi -lor a plurality of positioxia 



'I! 


f the mouse pad srft 
>iiib. An input unit arrange 
kng p&.CT:ern- By placing Llie 
places on the moun« 

111 ' 

inj^jut unit arrangement to carry 
jas chlanging autottiaclcally 
aril 'input function. 


|2 4 
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Field of the Invention 

This invention concerns an arrangement and a method 
for controlling an electronic device. 
Background of the Invention 

The Applicant's Swedish Patent No. 9604008-4 dis- 
closes a reading pen which can be used for recording text 
by imaging this. The reading pen has an optical sensor 
which captures a number of images, with partially over- 
lapping content, of the text which is to be recorded. In 
addition, the reading pen has a processor which puts 
together the images, identifies the text in the images 
and stores it in character-coded format. The text can 
then be transferred to a computer with . which the reading 
pen communicates. 

In addition, the Applicant's Swedish Patent No. 
9803456-4 discloses an optical mouse which is arranged 
to position a cursor on a display of a computer. 

The reading pen and the optical mouse are two exam- 
ples of input units which can be used to input informa- 
tion into a computer or to control the function of a com- 
puter. Another example of an input unit is . a keyboard, 
which can be used both to enter information and to con- 
trol the computer by means of various keyboard commands. 

A user does not want to have to change between dif- 
ferent input units in order to be able to carry out dif- 
ferent functions. Therefore it is a general requirement 
that each input unit is to be able to be used for as many 
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different functions as possible and in as flexible and 
simple a way as possible for the user. 
Summary of the Invention 

An object of this invention is therefore to provide 
an arrangement for controlling an electronic device which 
is simple for a user to use and which makes possible a 
combination with other input unit functions. 

This object is achieved by an arrangement according 
to claim 1. 

According to a first aspect, this invention concerns 
an arrangement for controlling an electronic device com- 
prising an input unit with an opt ical sensor for record- 
ing text by imaging this. by means of at least one image, 
and signal -processing means for identifying predeter- 
mined information in the imaged text and for controlling 
the electronic device dependent upon said predetermined 
information . 

According to the invention the arrangement for con- 
trolling an electronic device is based on an input unit 
function known per se, that is recording of text, which, 
however, is modified by making the signal -processing 
means identify predetermined information in the imaged 
text. Unlike the previously known input unit function, 
the content of the recorded text is interpreted instead 
of the text just being stored. A user can thus control 
the electronic device on the basis of text which is read 
using the input unit. The text can be predetermined com- 
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mands which are printed or written on a sheet of paper 
or some other product. The text can also be text which is 
used in specific applications in the electronic device, 
such as addresses. The content in these addresses varies, 
but the arrangement can recognize predetermined informa- 
tion, for example certain characters, which make it pos- 
sible for the arrangement to interpret what the text 
refers to. 

The arrangement according to the invention is simple 
for the user to use, as the user just needs to pass the 
input unit across the text or place it on the text in 
order to control the electronic device. In addition the 
arrangement can easily be combined with other input unit 
functions which are based on recording of images by an 
optical sensor. 

The signal -processing means are preferably realized 
as software. However, they can consist of a specially 
adapted hardware circuit, for example an ASIC, or some 
suitable combination of software and hardware. 

The electronic device which is controlled by means 
of the arrangement can- be a computer, a mobile telephone, 
a PDA or some similar electronic device. 

The optical sensor can be a line sensor, but is pre- 
ferably an area sensor. 

In a preferred embodiment, the predetermined infor- 
mation consists of at least one predetermined character 
and the signal -processing means are arranged to generate 
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a command associated with said character for controlling 
the electronic device. The signal-processing means can be 
arranged to identify special characters such as @, or 
predetermined words, word combinations or character com- 
binations. Each such character, word or combination can 
be associated with a special command. The command can be 
a command to the electronic device at system or applica- 
tion level. It can emulate a keyboard command. It can 
also be a special command, for example a user-defined 
command . 

The arrangement can advantageously comprise a read- 
ing pen function. The same arrangement can then be used 
by the user both for controlling the electronic device 
and for inputting text into it. The reading pen function 
can advantageously be realized in the same way as in the 
Applicant's above-mentioned patent. Other realizations 
are, however, also possible. 

In an advantageous embodiment, as an alternative to 
or a supplement to'the reading pen, the arrangement can 
comprise an optical mouse function for controlling a 
cursor on a display on . the electronic device. The user 
can then carry out mouse functions using the arrangement 
and also control the electronic device by recording text. 
The mouse function can advantageously be realized in the 
same way as in the Applicant's above-mentioned patent. 
Other realizations are, however, also possible. 



The arrangement can advantageously be changed 
between at least a first function mode, for example the 
reading pen or mouse function, and a second command mode, 
in which the signal -processing means are arranged to car- 
ry out said identification of predetermined information 
in the recorded text and control of the electronic 
device. This embodiment has the advantage that it simpli- 
fies the arrangement, as it only needs to interpret text 
in command mode. The danger of text which is only intend- 
ed to be entered and stored in the electronic device 
being wrongly interpreted as a command is also avoided. 

As an alternative, the signal-processing means 
should be able to interpret continuously the content 
in the text recorded by the optical sensor. In order to 
avoid words being interpreted as a command which are only 
intended to be entered and stored in the electronic 
device but which consist of the same character combina- 
tion as a command, additional requirements can be made 
regarding what the "signal -processing means are to inter- 
pret as a command. For example, it can be required that 
commands are to consist of characters in a particular 
font, font size or the like. 

In one embodiment the signal -processing means are at 
least partially located in the same casing as the elec- 
tronic device. By this means the input unit can be made 
simpler and cheaper. In addition the processor power 
which is already available in the electronic device can 
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be utilized in order to carry out the functions of the 
signal -processing means. Certain processing of the 
recorded text can, however, advantageously be carried 
out in the input unit, for example localization of the 
text in the image or images and conversion of the text 
to character-coded format, for example ASCII code, so 
'that a smaller amount of information needs to be trans- 
mitted from the input unit to the electronic device. 

In a less preferred embodiment the signal -processing 
means can be completely integrated with the input unit so 
that the electronic device receives one or more commands 
directly from the input unit. In another less preferred 
embodiment the input unit can just. record images and 
transfer these to the signal -processing means which car- 
ry out all the processing of the images. 

The input unit is advantageously arranged to commu- 
nicate with the electronic device by wireless means, so 
that the use of the input unit is as flexible as possible 
and so that certain functions can be used stand-alone. 
Alternatively, communication via a cable could be pos- 
sible, for example across a USB. 

In a particularly preferred embodiment the signal - 
processing means are arranged in such a way that when 
they identify an address for electronic mail in the 
recorded text, the electronic device is caused to open 
a program for electronic mail . The arrangement preferably 
causes the device not just to open the program but also 
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to open a template for electronic mail. It is even more 
preferable for the template to be opened with the record- 
ed e-mail address already entered in the address field. 

The identification of the e-mail address can, for 
example, be carried out by recognition of @, the signal - 
processing means interpreting all the characters which 
are associated with @ as part of the address. 

In addition the signal -processing means can advan- 
tageously be arranged so that when they identify a web 
address in the recorded text the electronic device is 
caused to open a web search program. The device is pre- 
ferably caused not just to open the program but also the 
web page corresponding to the web address. The identifi- 
cation of the web address by the signal -processing means 
can, for example, be based on recognition of the charac- 
ter combination "http://" or "www", the signal-processing 
means interpreting all the characters which are associat- 
ed with said character combination as part of the web 
address. In this way the user can simply and quickly open 
a web page by using the same input unit he or she uses 
for other input unit functions. 

In addition the signal -processing means can advanta- 
geously be arranged so that when they identify a tele- 
phone number in the recorded text, the electronic device 
is caused to ring the telephone number. 

As mentioned above ^ the signal -processing means can 
create a predetermined command upon recognition of one or 
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more predetermined characters or words in the recorded 
text. The predetermined words can quite simply be desig- 
nation of. the commands which are created.. For this pur- 
pose the arrangement can advantageously comprise a pro- 
duct by means of which a number of command indications 
are shown. The command indications can advantageously be 
represented by character combinations which are easy for 
the user to understand. The product can, for example, be 
a mouse pad. 

According to a second aspect of the invention, this 
concerns a method for controlling an electronic device, 
comprising the steps of recording text by means of a 
hand-held input unit by imaging this by means of at 
least one image, identifying predetermined information 
in the imaged text, and controlling the electronic device 
depending upon the imaged text . 

The advantages of this method are apparent from the 
discussion of the arrangement. Where appropriate, charac- 
teristics of the arrangement also apply for the method. 

In the Applicant's Swedish Patent Application No. 
9803455-6 an input unit is also known which has both an 
image-based mouse function and an image-based input func- 
tion. The function of the input unit is changed by the 
user pressing buttons. 

An additional object is to simplify the use of an 
input unit which has two functions so that the change 
between different functions can be carried out in a con- 
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venient way for the user. This object is achieved by 
means of a device according to claim 13 . 

More specifically, according to a third aspect, the 
invention comprises an input unit which has at least a 
first and a second function. The input unit comprises 
image -capturing means, for example an optical sensor, for 
capturing images and image-processing means, for example 
a processor, for processing the images to achieve the 
above-mentioned two functions. The input unit is arranged 
to change from the first to the second function when the 
image -processing means detect predetermined information 
in one of said images . 

The predetermined information can in principle be 
any information which makes it possible for the input 
unit to interpret that it is to change from a current 
function to a new function. The information can, for 
example, consist of one or more predetermined characters, 
symbols, words, text in special font or line thickness or 
the like. When the" input unit identifies the predetermin- 
ed information, it automatically changes to the required 
function. In this way the user does not need to press any 
buttons . 

In a preferred embodiment, the predetermined infor- 
mation is a predetermined pattern. If the input unit, for 
example, has a mouse function and another function, it 
can be programmed to be able to identify the pattern on 
a mouse pad. When the user places the input unit on the 
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mouse pad, the image -capturing means record an image 
of the pattern on the mouse pad. The image -processing 
means identify the pattern as predetermined information 
which indicates mouse function and the input unit changes 
automatically to mouse function and processes the images 
to achieve the mouse function. 

It is, of course, convenient if the input unit is 
also arranged to change from the second function to the 
first function when it detects other predetermined infor- 
mation. If the input unit has only a mouse function and 
an input function, it can, for example, change back from 
the mouse function to the input function when the image- 
processing meant detect that the predetermined . pattern 
for the mouse function is no longer present in the cap- 
tured images. Alternatively, the change can be carried 
out on the basis of positive identification of another 
predetermined pattern. 

In an advantageous embodiment, the predetermined 
information consists of a position-coding pattern, pre- 
ferably an absolute position-coding pattern. 

The advantage of position-coding patterns is that 
the predetermined information can consist of one or more 
specific positions. This makes it easier for the device 
to identify when it is to change, as it does not need to 
carry out any character recognition (OCR) . 

Absolute position-coding patterns are known for exam- 
ple from US 5,852,434 and the Applicant's SE 9901953-1 and 
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9903541-2 which were not publicly available at the time of 
the filing of the present application. 

The functions between which the change is made can, 
for example, be a mouse function/ a scanner function, a 
handwriting/hand-drawing function or some similar func- 
tion which can be carried out on the basis of captured 
images . 

Brief Description of the Drawing 

This invention will now be described in greater 
detail by means of one embodiment with reference to the 
accompanying drawing in which the figure shows schema- 
tically how an arrangement according to the invention can 
be constructed and used. 
Description of a Preferred Embodiment 

An embodiment of the arrangement is described below 
which comprises a mouse function, a scanner or reading 
pen function and a control function which is based on 
text recording. 

The figure shows a mouse pad 100, an electronic 
device 2 00 in the form of a computer and an input unit 
3 00 for the computer. 

The mouse pad has a working field 100 with an irre- 
gular pattern (not shown) which makes it possible to 
determine the relative positions of two images which have 
partially overlapping contents by means of the content of 
the images, and a command field 120, in which a number of 
predetermined commands are indicated. 
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The input unit 300 has a casing 1 in the shape of a 
pen. One short side of the casing has a window 2 through 
which . images are captured for the different image-based 
functions of the input unit. 

The casing 1 contains principally an optics part, an 
electronics part and a power supply. 

The optics part comprises a number of light emitting 
diodes 6, a lens system 7 and an optical sensor 8 which 
constitutes the interface with the electronics part. 

The light emitting diodes 6 are intended to illumi- 
nate a surface which is at the moment below the window. 

The lens system 7 is intended to project an image 
of the surface which is below the window 2 onto the 
light-sensitive sensor 8 in as correct a way as possible. 
The optical sensor 8 can consist of a two-dimensional 
quadratic CCD unit (CCD = charge-coupled device) with a 
built-in A/D transducer. Such sensors are commercially 
available . 

The power supply for the input unit is obtained from 
a battery 12 . 

The electronics part comprises a processor 20 with, 
conventional associated circuits, such as various types 
of memory, and associated programs for carrying out the 
functions described here. The electronics part also 
comprises a transceiver 26 for transmitting information 
to/from the computer 200. The transceiver can be based on 
infrared technology or radio technology for transmission 
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over short distances, for example in accordance with the 
Bluetooth standard. The electronics part further com- 
prises buttons 27, by means of which the. user can control 
the input unit and in particular change the input unit 
between the mouse function, the scanner function and the 
control function. When the mouse function is being used 
the buttons can^'also have functions which correspond to 
the click buttons on a traditional mouse. 

The computer 2 00 is an ordinary personal computer 
with circuits and programs which make possible communi- 
cation with the input unit 300. However, in this embodi- 
ment this also contains signal -processing means which 
constitute part of the arrangement for controlling its 
function. The signal -processing means consist of a pro- 
gram which is installed in the computer. This is shown 
symbolically by broken lines and reference numeral 210. 

As mentioned, the input unit 300 has a scanner func- 
tion, a mouse function and a control function. 

The scanner function is used to record text. The 
user passes the input unit across the text which he wants 
to record. The optical sensor records images with par- 
tially overlapping contents. The images are put together 
by the processor 20. Each character in the put-together 
image is localized and, using for example neural net- 
work software in the processor, it is determined to which 
ASCII character the character corresponds. The text con- 
verted in this way to character-coded format can be stor- 
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ed in the input unit or transferred to the computer 2 00. 
The scanner function is described in greater detail in 
the Applicant's Swedish Patent . No . :9604008-4. 

The mouse function is used to control a cursor on 
the display 201 of a computer 200. The mouse function is 
also image-based in this embodiment. When the input unit 
300 is moved across the working field 110, the optical 
sensor 8 records a number of images with partially over- 
lapping images. The processor 20 determines positioning 
signals for the cursor of the computer 200 on the basis 
of the relative positions of the recorded images, which 
are determined by means of the contents of the images. 
The mouse function is described in greater detail in the 
Applicant's Swedish Patent No. 9803456-4. 

The control function is based on the scanner func- 
tion. The user records text in the same way as in the 
scanner function. The text is sent in character-coded 
format from the input unit's transceiver to the signal- 
processing means 210 in the computer 2 00, together with 
an indication that this is control information which is 
to be interpreted. The. signal -processing means examine 
the received text and search for predetermined informa- 
tion in this in the form of predetermined characters and 
character combinations. When such predetermined informa- 
tion is found, the signal -processing means create pre- 
determined commands to the computer as a function of the 
predetermined information . 
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The arrangement described above is used in the fol- 
lowing way. First assume that the user wants to use the 
input, unit as a. mouse. He selects the mouse function by- 
means of the buttons 27. By moving the input unit on the 
working field he controls the cursor on the display 201 
of the computer 200. Assume next that the user edits a 
document in the computer 200. He can then mark text by 
"clicking" with the buttons 27, Assume that the user 
first wants to replace a first piece of text with a 
second piece of text which is situated elsewhere in the 
text. The user marks the second piece of text using the 
input unit. Then he changes the input unit to the control 
function and records the command "cut" by passing the 
input unit across this command on the mouse pad 100. The 
input unit then sends the character-coded text "cut" to 
the signal -processing means 210 in the computer 2 00, 
which identify the text as a command and create a corre- 
sponding command for the word-processing application con- 
cerned, which cuts'out the marked piece of text. The user 
next marks the first piece of text using the input unit 
and then causes . the computer to paste the cut-out piece 
of text in place of the marked text by recording the com- 
mand "paste" using the input unit. 

Now assume that the user next wants to enter text 
from a newspaper in his document. He first positions the 
cursor in the required place using the mouse function 
of the input unit. Then he changes the input unit to the 
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scanner function and scans in the text from the news- 
paper. The text is converted to character-coded format 
and transmitted .to the signal -processing means which . 
insert the text in the position marked by the cursor. 

Now assume that the user sees an interesting web 
address in the newspaper he is reading and wants to look 
at this web page. He then changes the input unit to con- 
trol function and reads off the web address from the 
newspaper. The recorded text is transferred to the 
signal -processing means which identify the character com- 
bination "http://" and cause the computer to open the web 
page with the recorded address. 

Finally, assume that the user wants to send an 
e-mail to a friend. He uses the control function of the 
input unit to record the command "e-mail" on the mouse 
pad. Recognition of this command by the signal -processing 
means results in the means generating a command to the 
computer which causes it to open the e-mail program. The 
user can then record the required e-mail address and even 
the content of the message using the scanner function. 

As shown above, the user can convenient ly . carry out 
a number of different functions which comprise inputting 
information and controlling the computer 200 by means of 
just one input unit . 

Of course, other functions can be integrated into 
the input unit in order to further increase its usabili- 
ty. An example is a function to record handwritten text. 
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which is described in the Applicant's Swedish Patent No. 
xxxxxxx . 

other commands can .be created in addition . to those 
described above. A user can also himself define how 
recorded text is to be interpreted by the signal -process- 
ing means and in which control of the computer a particu- 
lar recorded piece of text is to result . 

The change described above between the different 
functions is carried out by the user pressing buttons 
on the input unit. 

As an alternative to this, the input unit can itself 
detect that it is to change between different functions. 

The input unit can, for example, be arranged to 
search for predetermined information in each image which 
is captured by the optical sensor 8. The predetermined 
information can, for example, be the pattern on the work- 
ing field 12 0 of the mouse pad. When the processor 2 0 
detects this pattern, it changes to the mouse function 
and processes the images in the way described above to 
provide positioning signals for the cursor on the display 
201 of the computer 200. When the user thereafter places 
the input unit on a newspaper in order to scan in text, 
the processor 2 0 no longer detects the mouse pad pattern 
and so it knows that it is to change to the scanner func- 
tion and process the images in the way described above 
for the identification of text and conversion of imaged 
text to character-coded format. This technique can also 
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be used for changing to the control function. The com- 
mands in the mouse pad's command field can be written in 
a particular way so that the processor can detect, that 
the characters are not characters which are to be entered 
into the computer by the scanner function, but are char- 
acters which represent commands and are to be sent to the 
signal -processing means in order to be processed as such. 
The commands can, for example, be written in a particular 
size, particular font or particular line thickness. 

As another example, the change can be implemented 
on the basis of change commands which are written in the 
command field of a mouse pad. When the user wants to 
change to scanner function he records the word "scanner" 
from the command field using the input unit. The proces- 
sor 20 identifies this as predetermined information which 
indicates that it is now to carry out a scanner function. 

Above the pattern on the mouse pad 10 0 is described 
as an irregular pattern and the mouse function is 
described as being "achieved by determination of the 
relative position of the recorded images. In another 
embodiment, the pattern on the. mouse pad can be a posi- 
tion-coding pattern, which systematically codes positions 
over the whole of the mouse pad. In this case the mouse 
function can be based on reading off positions using the 
position- coding pattern. In addition the change to mouse 
function can be based on recognition of the position- 
coding pattern. In addition particular positions or posi- 
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tion areas (also called domains) can be dedicated to par- 
ticular functions, for example those corresponding to the 
different commands. in the command field. When the proces- 
sor detects a particular position, it determines which 
function corresponds to this position. In this way the 
input unit can be caused to change from one function to 
another function by placing it in a particular position 
on the mouse pad. Different domains of the position- 
coding pattern can also be dedicated to commands for 
controlling the computer 200. Instead of the signal- 
processing means in the computer 200 detecting predeter- 
mined information in the text which is entered, they can 
thus detect positions in the form of coordinates and 
identify which command is to be created to control the 
computer 200. For example, if the user wants to open the 
e-mail program in the computer 2 00, he can place the 
input unit on the mouse pad in a position where it says 
"e-mail". The optical sensor 8 records an image of the 
position-coding pattern in this position. The processor 
identifies which position, that is which coordinates, 
corresponds to the position-coding pattern in the image. 
It sends the coordinates to the signal -processing means 
in the computer 2 00. The signal -processing means identi- 
fy that these coordinates mean that they are to create 
a command to the computer which causes it to open the 
e-mail program. 
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The mouse pad can thus be divided into position 
areas or domains with different functions. An additional 
example of this is that one area can be dedicated to 
relative mouse function (the cursor is moved in the same 
way as the input unit) and another area to absolute mouse 
function (the cursor is placed in the position which cor- 
responds to the position of the input unit on the mouse 
pad) . The input unit itself understands which function 
it is to use on the basis of whether the position-coding 
pattern (and hence the identified coordinates) belongs to 
one or the other area. Of course, alternatively the same 
surface can be used for the relative and absolute func- 
tions and the change can be carried out by means of 
change commands in the way described above. 

A further example is that the mouse pad can have 
an area which is dedicated to a scrolling function. The 
input unit can thus be a mouse with various mouse func- 
tions. It can also be a mouse which, in addition to con- 
trolling a cursor on a computer, can control other func- . 
tions of the computer or other electronic devices, such 
as mobile telephones or PDA. 

The above example is just one example of how the 
arrangement according to the invention can be designed. 
Based on the summary of the invention, experts in the 
field can achieve a number of variants of this example. 



what we claim and desire to secure by Letters Patent 

is : 

1. An. arrangement, for controlling an electronic 
device, characterized by an input unit with 
an optical sensor for recording text by imaging this by 
means of at least one image, and signal -processing means 
for identifying predetermined information in the imaged 
text and for controlling the electronic device dependent 
upon said predetermined information. 

2. An arrangement according to claim 1, wherein the 
predetermined information consists of at least one pre- 
determined character and wherein the signal -processing 
means are arranged to generate a command associated with 
said character for controlling the electronic device. 

3. An arrangement according to claim 1 or 2 , which 
arrangement comprises a reading pen function. 

4. An arrangement according to any one of the pre- 
ceding claims, which arrangement comprises an optical 
mouse function for controlling a cursor on a display on 
the electronic device. 

5. An arrangement according to any one of the pre- 
ceding claims, which arrangement can be changed between 
at least a first function mode and a command mode, in 
which the signal -processing means are arranged to carry 
out said identification of predetermined information in 
the recorded text and control of the electronic device. 
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6. An arrangement according to any one of the pre- 
ceding claims, in which the signal -processing means are 
at least partially located in . the same casing as the 
electronic device. 

7. An arrangement according to any one of the pre- 
ceding claims, wherein the input unit is arranged to com- 
municate with the electronic device by wireless means. 

8. An arrangement according to any one of the pre- 
ceding claims, wherein the signal -processing means are 
arranged in such a way that when they identify an address 
for electronic mail in the recorded text, they cause the 
electronic device to open a program for electronic mail . 

9. An arrangement according to any one of the pre- 
ceding claims, wherein the signal -processing means are 
arranged in such a way that when they identify a web 
address in the recorded text, they cause the electronic 
device to open a web search program. 

10. An arrangement according to any one of the pre- 
ceding claims, wherein the signal -processing means are 
arranged in such a way that when they identify a tele- 
phone number in the recorded text, they cause the elec- 
tronic device to phone the telephone number. 

11. An arrangement according to any one of the pre- 
ceding claims, comprising a product on which a number of 
command words are indicated. 

12. A method for controlling an electronic device, 
comprising the steps: 


recording text by means of a hand-held input unit, 
by imaging this by means of at least one image, 

identifying predetermined information in the imaged 
text , and 

controlling the electronic device dependent upon the 
imaged text . 

13 . An input unit with at least a first and a second 
function, comprising image -capturing means for capturing 
images and image -processing means for processing the 
images to achieve said two functions, character- 
ized in that the input unit is arranged to change from 
the first to the second function when the image-process- 
ing means detect predetermined information in one of said 
images. 

14. An input unit according to claim 13, wherein 
said predetermined information is a predetermined pat- 
tern. 

15. An input unit according to claim 13 or 14, 
wherein the input unit is arranged to change from the 
second function to the first function when it detects 
other predetermined information. 

16. An input unit according to any one of claims 
13-15, wherein said predetermined information consists of 
a position-coding pattern, preferably an absolute 
position- coding pattern . 


24 


17. An input unit according to any one of claims 
13-16, wherein the first function is a mouse function 
and the second function is an input function, . preferably 
a scanner function. 


Abstract of the Disclosure 


An arrangement for controlling an electronic devic 
has an input unit with an optical sensor for recording 
text by imaging this using at least one image, and 
signal -processing means for identifying predetermined 
information in the imaged text and for controlling the 
electronic device dependent upon said predetermined 
information . 



